AI-based novelty detection in crowdsourced idea spaces

نویسندگان

چکیده

Processing large and heterogeneous numbers of ideas submitted to crowdsourcing contests is a regular challenge for idea evaluators. The aim this study investigate potential use case AI-based innovation management extend the knowledge using automated novelty detection in evaluation processes. language models can automatically allocate short texts according their semantic similarity an embedded space. We represent content crowdsourced with three contemporary text embeddings – Doc2Vec, SBERT, GPT-3-based Ada Similarity compute distance different reference sets algorithms. then compare algorithm-generated scores human assessments validate them. While selected based on correlate humans, our results show that SBERT best match assessments. also find approaches perform better below median word count when compared set existing solutions, suggesting chosen model not only factor influencing applicability proposed approach. Furthermore, highlights important features limitations generated need be considered complementing evaluators searching new beyond.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Novelty Detection in Projected Spaces for Structural Health Monitoring

The aim of Structural Health Monitoring (SHM) is to detect and identify damages in man-made structures such as bridges by monitoring features derived from vibration data. A usual approach is to deal with vibration measurements, obtained by acceleration sensors during the service life of the structure. In this case, only normal data from healthy operation are available, so damage detection becom...

متن کامل

Modelling efficient novelty-based search result diversification in metric spaces

a r t i c l e i n f o a b s t r a c t Novelty-based diversification provides a way to tackle ambiguous queries by re-ranking a set of retrieved documents. Current approaches are typically greedy, requiring O (n 2) document–document comparisons in order to diversify a ranking of n documents. In this article, we introduce a new approach for novelty-based search result diversification to reduce th...

متن کامل

Graph-Based Text Representation For Novelty Detection

We discuss several feature sets for novelty detection at the sentence level, using the data and procedure established in task 2 of the TREC 2004 novelty track. In particular, we investigate feature sets derived from graph representations of sentences and sets of sentences. We show that a highly connected graph produced by using sentence-level term distances and pointwise mutual information can ...

متن کامل

Crowdsourced Idea Generation: The Effect of Exposure to an Original Idea

The effect of exposure to an original or common idea on crowdsourced idea generation was studied by asking crowd workers to design a public service advertisement. As compared to having no idea exposure, exposure to an original idea decreased fluency and increased the average originality of ideas generated by each person. By contrast, exposure to a common idea had no effect on either idea origin...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Innovation-management Policy & Practice

سال: 2023

ISSN: ['1447-9338', '2204-0226']

DOI: https://doi.org/10.1080/14479338.2023.2215740